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Team Decision Problems with Convex Quadratic Constraints 

Ather Gattami 


Abstract —In this paper, we consider linear qnadratic team 
problems with an arbitrary nnmber of qnadratic constraints in 
both stochastic and deterministic settings. The team consists of 
players with different measurements about the state of nature. 
The objective of the team is to minimize a quadratic cost subject 
to additional finite number of quadratic constraints. We first 
consider the problem of countably infinite number of players 
in the team for a bounded state of nature with a Gaussian 
distribution and show that linear decisions are optimal. Then, we 
consider the problem of team decision problems with additional 
convex quadratic constraints and show that linear decisions are 
optimal for both the finite and infinite number of players in the 
team. For the finite player case, the optimal linear decisions can 
be found by solving a semidefinite program. Finally, we consider 
the problem of minimizing a quadratic objective for the worst 
case scenario, subject to an arbitrary number of deterministic 
quadratic constraints. We show that linear decisions are optimal 
and can be found by solving a semidefinite program. Finally, we 
apply the developed theory on dynamic team decision problems 
in linear quadratic settings. 

Index Terms —Team Decision Theory, Stochastic, Determin¬ 
istic, Game Theory, Quadratic Constraints, Convex Functional 
Optimization. 

I. Introduction 

We consider the problem of distributed decision making 
with information constraints and quadratic constraints un¬ 
der linear quadratic settings. For instance, information con¬ 
straints appear naturally when making decisions over net¬ 
works. Quadratic constraints appear due to the power limited 
controllers in practice for instance. These problems can be 
formulated as team problems. The team problem is an op¬ 
timization problem with several decision makers possessing 
different information aiming to optimize a common objective. 
Early results in 11 considered static team theory in stochastic 
settings and a more general framework was introduced by 
Radner 12, where existence and uniqueness of solutions where 
shown. Generalization to dynamic team problems for control 
purposes where introduced in 0. In a, the deterministic 
team problem with two team members was solved. The 
solution can’t be easily extended to more than two players 
since it uses the fact that the two members have common 
information; a property that doesn’t necessarily hold for more 
than two players. Also, a nonlinear team problem with two 
team members was considered in 0, where one of the team 
members is assumed to have full information whereas the other 
member has only access to partial information about the state 
of the world. Related team problems with exponential cost 
criterion were considered in l6|. Optimizing team problems 
with respect to affine decisions in a minimax quadratic cost 
was shown to be equivalent to stochastic team problems with 
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exponential cost, see 0. The connection is not clear when the 
optimization is carried out over nonlinear decision functions. 
The deterministic version (minimizing the worst case scenario) 
of the linear quadratic team decision problem was solved 
in 0. The problem of countably infinite number of players 
under the power semi-norm was solved in 0 under certain 
assumptions. 

In this paper, we will consider both Gaussian and determin¬ 
istic settings (worst case scenario) for team decision problems 
under additional quadratic constraints. It’s well-known that 
additional constraints, although convex, could give rise to 
complex optimization problems if the optimized variables are 
functions (as opposed to real numbers). For instance, linear 
functions (that is functions of the form ffix) = Kx where K 
is a real matrix) are no longer optimal. We will illustrate this 
fact by the following example. 

Example 1: For a; S M, we want to minimize the objective 
function 


subject to 

\x — up < 7 

Some Hilbert space theory shows that the optimal u is given 
by 

u = p{x) = {\x\-y/j)x/\x\ if |a;p> 7 , 

and 

u = p{x) = 0 otherwise. 

Obviously, the optimal u is a nonlinear function of x. 

Increasing the dimension of x, and adding constraints 
on the structure of u, for instance x G and u = 

p{x) = {p{xi), p{xn)), certainly makes the constrained 
optimization more complicated. The example above shows 
that, in spite of having a convex optimization carried out over 
a Hilbert space, the optimal decision function is nonlinear. 
However, we show in the upcoming sections that problems 
multiple quadratic constraints behave nicely when considering 
the expected values of the objectives in the Gaussian case, in 
the sense that linear decisions are optimal. We also extend the 
results to the case of infinite number of players in the team. 
For the deterministic counterpart which is not an optimization 
problem over a Hilbert space, we show that linear decisions are 
optimal and we show how to find the linear optimal decisions 
by semidefinite programming. Finally, we apply the developed 
theory on dynamic team decision problems in linear quadratic 
settings. 
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II. Notation 

The following table gives a list of the notation we are 
going to use throughout the paper: 


R+ 

The set of nonnegative real numbers. 

N 

The set of positive integers. 

S” 

The set of n x n symmetric positive 
semidefinite matrices. 

S++ 

The set of n x n symmetric positive 
definite matrices. 

M 

The set of measurable functions. 

C 

The set of functions /i : R^ —)• R™ with 
Kv) = L*2iy2), PNiVN))*, 

Pi : RP‘ R'^S J2i UT-i = rn, J2iP^ = 

Ai 

The element of A in row position i. 


A>B A- B GEf. 


Ay B A- B G S!;:+. 

IK 

K = {iV|iV = diag(iVi,...,iT^), 

Ki G R^'^'P-}. 

Tr 

Tr{A} is the trace of the matrix A. 

N{m, X) 

The set of Gaussian variables with 

mean m and covariance X. 


III. Linear Quadratic Gaussian Team Theory 


In this section, we will review a classical result in stochastic 
team theory for a finite number of decision variables and 
present an extension to the case of infinite number of decision 
variables. 

In the static team decision problem, one would like to solve 


min E 

X 

* 

Qxx 

Qxu 


X 


u 


Qux 

Quu 


U 


subject to yi = CiX + Vi 
= Hiivi) 
for i = 1,..., N. 


( 1 ) 


Here, x and v are independent Gaussian variables taking values 
in K” and respectively, with x ~ N{Q^Vxx) and v ~ 
A/'(0,14t,). Also, yi and Ui will be stochastic variables taking 
values in R'^L respectively, and pi + ... +pjv = P- We 
assume that 

Qxx 
ux 


e S' 


m+n 


( 2 ) 


and Quu S 8!^“+, m = mi + • • • + mjsf. 

If full state information about x is available to each decision 
maker Ui, the minimizing u can be found easily by completion 
of squares. It is given by rt = Lx, where L is the solution to 


QuuL — Qx 


Then, the cost function in ([T]) can be rewritten as 

Zl) — Ejx {Qxx kj Quu^)^y~i~ 

E{(m - LxYQuu{u - Lx)}. 

Minimizing the cost function J{x,u), is equivalent to mini¬ 
mizing 


since nothing can be done about E{x^(Qxx — L'^QuuL)x} 
(the cost when u has full information). 

The next result is due to Radner El, showing that linear 
decision are optimal for the finite-dimensional static team 
problem 

Proposition 1 (Radner): Let x and w, be Gaussian variables 
with zero mean, taking values in R" and R^’L respectively, 
with Pi + ... + pn = p. Also, let Ui be a stochastic variable 
taking values in R"*L Quu e S!p+, m = mi -f • • • -f mM, 
L e C^ G for i = 1, ...,7V. Then, the optimal 

decision p to the optimization problem 

min E{(u — Lx)*Quu(u — Lx)} 

subject to yi = CiX + 

Ui = Piiyi) 
for 2 = 1,..., N. 
is unique and linear in y. 

Proof: For a proof, see E). ■ 

It’s not clear how to extend the result above to the case of 
infinite number of state and decision variables, that is = c». 
This is an important case to approach dynamic team problems, 
where the decision variables are over space and time, and the 
time horizon that goes to infinity. 

The next theorem establishes a generalization of the above 
proposition for the infinite-dimensional case. 

Theorem 1: Let x = x *2 ...)* and v = (uj" ..•)* 

be infinite-dimenational vectors where Xi is Gaussian taking 
values in R"* and Vi is Gaussian taking values in R^*’. Suppose 
that E{a;*a:}, E{z;*u} < oo. Also, let u = {u\ u}, ...)* be a 
random infinite-dimensional vector with Ui taking values in 
Quu an infinite dimensional, bounded, positive definite, 
self-adjoint linear operator, L a bounded linear operator, and 
Ci G RP’^°° a bounded linear operator, for all z G N. Then, 
the optimal decision p to the optimization problem 

inf E{[u — Lx)*Quuiu — Lx)} 

subject to yi = CiX Vi 
Ui = Pi{yi) 

for all 2 G N. 
is unique and linear in y. 

Proof: Note first that yi is bounded since Ci, x, and Vi 
are bounded. 

Let Z be the linear space of functions such that z G Z if 
Zi is a linear transformation of yi, that is Zi = Aiyi for some 
real matrix Ai G R^'^pg Since Quu is a bounded symmetric 
positive definite linear operator, Z is a linear space under the 
inner product 

{g,h) = E{g*Quuh}, 

and norm 

\\gf = E{g^Quug}. 

The optimization problem in Q where we search for the linear 
optimal decision can be written as 

min Ijit —La;||^ 

u^Z 


E{(22 - Lx)'^Quu{u - Lx)}, 


( 6 ) 
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Finding the best linear optimal decision it* S Z to the above 
problem is equivalent to bnding the shortest distance from the 
subspace Z to the element Lx {Lx is bounded since L and 
X are bounded), where the minimizing u* is the projection of 
Lx on Z, and hence unique. Also, since it* is the projection, 
we have 


0 = (u* - Lx, u) = E{(ii* - Lx)*Quuu}, 

for all u e Z. In particular, for ft = (0,0, Zi, 0,0,...) G Z, 
we have 

E{(ii* - LxYQuuh} = E{[(ii* - LxYQuu]^z^} = 0. 
The Gaussian assumption implies that 
[(it* - Lx)*Quu]i 

is independent of Zi = Aiyi, for all linear transformations Ai. 
This gives in turn that [(it* — Lx)*Quu]i is independent of yi. 
Hence, for any decision p, G AI H C, linear or nonlinear, we 
have that 

E(it* Lx') QuuL^y) — ^ ^ Lx) Quuliy’iiyi)} 

i 

= 0 , 

and 

E(p(y) - Lx)*Quuipiy) - Lx) 

= E(ii* - Lx + y.{y) - ii*)*(3„„(ii* - Lx + y{y) - u*) 

= E(it* - Lx)*QuuiUi, - Lx) 

+ E(p(y) - u*)*Q„„(p(i/) - u*) 

+ 2E(it* - Lx)*QuuiKy) - u*) 

= E(it* - Lx)*Quu{Ui, - Lx) 

+ E(p(y) - uY*Quu{L{y) - U*) 

Z. E(it* Lx) Lx) 

with equality if and only if p(j/) = it*. This concludes the 
proof ■ 


IV. Team Decision Problems with Power 
Constraints 

In practice, we often have power constraints on the control 
variables of the from 7 ^ > E|pi(i/i)p. The question is whether 
linear decisions are optimal and if there is a practical algorithm 
that can obtain optimal decisions. The introductory example 
clearly showed that linear decisions are not optimal for the 
case of point-wise optimization with a power constraint. Thus, 
there is no reason to expect that linear decisions are optimal 
for the stochastic (average) case. This will be addressed in this 
section. 

Consider the modihed version of the optimization problem 

0: 

min E 


X 

*■ 

Q 

s' 


X 

u 


s* 

R 


u 


subject to yi = CiX 

Ui = y^iiyi) 

li > E|p,(i/i)|2 

for 1 = 1,..., N. 


(7) 


The difference from Radner’s original formulation is that 
we have added power constraints to the decision functions, 
7 i > E|pi(i/i)p. Note that additional constraints in functional 
optimization could give rise to complex nonlinear optimal 
solution as was shown in Example in the introduction. 

In the sequel, we will prove a more general theorem, where 
we consider power constraints on a set of quadratic forms in 
both the state x and the decision function p. 


Theorem 2: Let x be a Gaussian variable with zero mean 
and given covariance matrix X, taking values in K". Also, 
Qo S'o] 


let 


i?Q 


G S™+” 


, 7?o e s 


++’ 


Qj 


S, 

Ri 


G S™+”, and 


Rj G S™, for j = Assume that the optimization 

problem 


min E 

mgc 


subject to E 


X 

* 

Qo 

5o' 

X 

_ll{x)_ 


S*o 

Ro 

_p(x)_ 

X 

* 

Qj 

Si 

X 

_p(x)_ 



Sj_ 

_p(x)_ 


< Ij 




( 8 ) 


is feasible. Then, linear decisions p given by p(x) = K{X)x, 
with K{X) G K, are optimal. 

Proof: Consider the expression 


E 


X 


Qo 

So 

X 

_p(x) 


s* 

Ro 

_p(x)_ 


M 

i=i 


E 


X 

p(x) 


Qj Sj 

S* Ri 


X 

p(x) 



Take the expectation of a quadratic form with index j to 
be larger than 7 _,. Then, Xj —)■ 00 makes the value of the 
expression above inhnite. On the other hand, if the expectation 
of a quadratic form with index j is smaller than 7 j, then the 
maximizer Xj is optimal for Xj = 0. 

Now let p* be the optimal value of the optimization problem 
and consider the objective function 


X 

* 

Qo 

So 


X 

u 


s* 

Ro 


u 


= x*{Qii-SoR^^Sl)x 

+ {u + Ro^S;x)*Ro{u + Rq^S^x). 


We have that Qo ~ SqRq ^S'q ^ 0, since it’s the Schur com- 

o s 

plement of Rq in the positive semi-dehnite matrix ° 

[5g Ro 

Since iig ^ 0^ a necessary condition for the objective function 
to be zero is that u = —R)^^SqX, and so u must be linear (In 
order for u to have the structure given by C, Rq^Sq must be 
in K, to satisfy the information constraints). 












































4 


Now assume that p* > 0. We have 


Pi, = min max E 

/jSC Ai6IR+ 


X 

* 

Qo 

So' 

X 

_p(x) 


5o* 

Ro 

p(x) 


+ ( E 

i=i ^ 


X 

p{x) 


Qj Sj 
S* i?,- 


p{x) 


■Ij 


■ min max 

l-L^C AjGK_|_ 


E 


X 

p{x) 


Qo So 
So* i?o 


M 

+ ^ Ai 


s; R, 


M 

i=i 

Now introduce An and the matrix 


X 

p{x) 


(9) 


Q S' 
S* R 


M 

i=o 


Qj Sj 

iS* Rp 


and consider the minimax problem 


Po = min max E 

/iGC -^^>0 


X 

* 

Q S' 

X 

_n{x)_ 


S* R 

p{x) 




M 


i=i 


( 10 ) 


Note that a maximizing Aq must be positive, since Aq = 0 
implies that po < 0, while Aq > 0 gives po > 0. We can 
always recover the optimal solutions of ([^ from that of ( [T0| ) 
by dividing all variables by Aq, that is p* = Po/Aq, Aj 
Xj/Xo, and p p/Aq. Now we have the obvious inequality 
(minmax{-} > maxminj-}) 


Po > max min E 

Aj ^0 fi^C 

M 




Qj 



X 

p(x) 


Po > max min E 

Aj>0 fiGC 

T,fLo A.-i 

M 

- E 

i=i 

= max min E 

Aj>0 K£K 

E“oE-1 

M 

i=i 


X 

p{x) 


X 

Kx 


M 

E^-' 

3=0 


E^^ 

3 = 0 


Qj 

s; 


Qj 

Sj 



X 

fl{x) 



X 

Kx 


The objective function is radially unbounded in K since R >- 
0. Hence, it can be restricted to a compact subset of K. Thus, 


Po > max min E 
\i>0 kgk 


M 


X 

Kx 


- E 


i=i 

= min max E 

KGK Xj >0 

E,^oE-i 

M 

- E 

i=i 

> min max E 

(i^C Xj ^0 

E,^oE-i 

M 

- E 

i=i 


X 

Kx 



Qj 

iS* 



Qj 

is; 



Qj 



X 

Kx 



X 

Kx 



X 

jl{x) 


= Po, 

where the equality is obtained by applying Proposition in 
the Appendix, the second inequality follows from the fact that 
the set of linear decisions Kx, K G K, is a subset of C, and 
the second equality follows from the definition of po- Hence, 
linear decisions are optimal, and the proof is complete. ■ 
Remark: Although Theorem [T] is stated and proved for y = 
X and u = y,{y) = p(a:), it extends easily to the case y = Cx 
for any matrix C, which is often the case in applications. Note 
also that we may set N = oo and the result would still hold 
by using Theorem in the proof. 


For any fixed values of Xj, we have i? >- 0, so Theorem [T] 
gives the equality 


V. Computation of The Optimal Team Decisions 
The optimization problem that we would like to solve when 
assuming linear decisions is 


min E 

/iGC 


min E 

agk 


X 

'Q 

s' 

X 

jl{x)_ 

s* 

R 

_y{x) 

X 

'Q 

S'] 

X 

Kx 

s* 

R 

Kx 


min 

7o,i<'GK 


7o 


subject to 


X 

* 

Qj 



X 

KCx 



Rj_ 


KCx 


< 7j, 


j = 0, 


x^J\f{ 0 ,H^). 


( 11 ) 


where the minimizing K is unique. Thus, 





















































































5 


with H >- 0. Note that we can write the constraints as 


E 


X 

* 

Qj 

Sj 


X 

KCx 



Rj 


KCx 


= E<^ Tr 


I 

KC 


Qj 


Sj 

Rj 


I 

KC 


( 12 ) 


= TrH 


I' 

* 

Qj 

Si 

■ I ' 

KC 


[^1 

Rj 

KC 


H, 


where we used that Exx* = X = H^. Hence, we obtain a set 
of convex quadratic inequalities (convex since Rj ^ 0 for all 

j) 


TrH 


■ I ' 

* 

Qj 


■ I ' 

KC 



Rj 

KC 


H < 7j . 


There are many existing computational methods to solve 
convex quadratic optimization problems (see flOl ). 

Alternatively, we can formulate the optimization problem as 
a set of linear matrix inequalities as follows. For simplicity, 
we will assume that Rj >- 0 for all j (The case Rj ^ 0 is 
analogue with some technical conditions). 


Theorem 3: The team optimization problem (111 is equiv¬ 
alent to the semi-dehnite program 


min 7 o 

70,ifeK 


subject to TrPj < H 


0 -< 


Pj - HQj H - HSj KCH - HC*K* S* H HC*K*Rj 


RjKCH 


Ri 


Pj-H 


Now we have that 


O^Pj-H 


■ / 

* 

Qj 

Si 

I ' 

KC 



Rj 

KC 

■ I ■ 

* 

Qj 

Si 

■ I ' 

KC 


Sj 

Rj 

KC 


H>0. 


H 


= Pj - HQjH - HSjKCH - HC*K*SjH 
- HC*K*R,KCH. 


Since Rj >- 0, the quadratic inequality above can be trans¬ 
formed to a linear matrix inequality using the Schur comple¬ 
ment ( IfTOl ). which is given by 


0 -< 


Pj - HQjH - HSjKCH - HC*K*SjH HC*K*Rj 


RjKCH 


R, 


Hence, our optimization problem to be solved is given by 


mm 7o 

7o,ifeK 


0 -< 


subject to TrPj < Ij 

Pj - HQj H - HSj KCH - HC*K* S* H HC*K*Rj 


RjKCH 


R-i 


which proves our theorem. 


VI. Deterministic Team Problems with Quadratic 
Constraints 

We considered the problem of static stochastic team decision 
in the previous sections. This section treats an analogous 
version for the deterministic (or worst case) problem. For the 
dynamic setting with partially nested information(which will 
be discussed in the next section), this corresponds to the Rao 
control problem. Although the problem formulation is very 
similar, the ideas of the solution are considerably different, 
and in a sense more difficult. 

The deterministic problem considered is a quadratic game 
between a team of players and nature. Each player has limited 
information that could be different from the other players in 
the team. This game is formulated as a minimax problem, 
where the team is the minimizer and nature is the maximizer. 

Consider the following team decision problem 

inf J(x, u) 


(13) 


subject to yi = CiX 

Ut = yiiivi) 
for * = 1,..., N 

where m € m = mi H— • -f m^, Ci € 
J{x,u) is a quadratic cost given by 


(16) 


where 


i = 0 ,...,M. 

Proof: Introduce the matrices Pj G S", and write the 
given constraints as 

7j > TrPj 


J{x, u) = sup 

X<1 


X 

* 

Qxx 

Qxu 


X 

u 


Qux 

Quu 


U 


Qx 

Qn 




m-\-n 


We will be interested in the case Quu >~ 0- The players ui,..., 
ujsi make up a team, which plays against nature represented 
by the vector x, using fi G S, that is 


(14) 


y{Cx) = 


Mi(C'ix) 


(15) 


X 

* 

Q S' 

X 

jii,{Cx)_ 


S* R 

jJLi,{Cx)_ 


for all X. This is equivalent to 


_y,N{CNx)_ 

Now consider the team problem and note that an 
equivalent condition for the existence of a decision function 
S C that achieves the value of the game 7 * is that 


< 7*k|' 


< 0 


for all X. This is an example of a quadratic constraint. 
We could also have a set of quadratic constraints that have 
to be mutually satished. For instance, in addition to the 
minimization of the worst case quadratic cost, we could have 
constraints on the induced norms of the decision functions 

\yt{C^x)\ ^ all X 7 ^ 0, i = 1,..., M, 

|x |2 

or equivalently given by the quadratic inequalities 


X 

* 

Q - 7*1 S 

X 

jj.i,{Cx)_ 


s* P. 

yt*(C'x)_ 
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Qj Sj 


e S' 


m+n 


sup 


X 

* 

Qj Sj 

X 

_p{x) 


Rj. 

_p{x)_ 


<0, J = 0 ,..., M . 


E 


X 

* 

Qj Sj 

X 

_p{x)_ 


Rj Rj. 

_p{x)_ 


< 0 . 


min E 

AieC 


X 

* 

Qo 

5o' 

X 

_p{x) 


55 

Ro 

_p{x)_ 

X 

* 

Qj 

Sj' 

X 

_p{x) 



Rj 

_p{x)_ 


< 0 


0 > E 
= E|a;* 

= Tr 


X 

* 

Qj Sj 

X 

K{X)x 


RA 

K{X)x 


I 

* 

Qj 

Sj' 

I 

x\ 

K{X)_ 



Rj 

K{X)_ 



I 

* 

Qj Sj 

I 

K{X)_ 


S*j Rj. 

KiX)_ 




for all j. Now let > 0, z = 0, M, and 

M 

= E% 


Q 

s* 


i=o 


Qj Sj 

is; R^. 


Introduce the set 


= {X -.X^ 0,TrX = 1}. 


The fact that for every covariance matrix X there is a matrix 


\^ii{Cix)'^ — "fi\x\^ <G for all a:, z = l,...,M. 

Also, the team members could share a common power source, 
and the power is proportional to the squared norm of the 
decisions jXi. 

M 

\lJ,i{Cix)\'^ — c|a:p < 0 for all x, 

i=l 

for some positive real number c. 

It’s not clear whether linear decisions are optimal, since the 
example given at the introduction indicates that, in determin¬ 
istic settings, nonlinear decisions are optimal pointwise. 
Theorem 4: Let 


K{X) such that (19i holds implies 


max min Tr 

Ai>0,JVGX K&K 



* 

Q 

s' 



K 


s* 

R 


K 


X <0. 


For every fixed X, we have a max-min problem which is 
convex in K and linear in A^, so we can switch the order of 
the minimization and maximization to get the max-min-max 
inequality 


max min max Tr 

XGXKGK\i>0 


' I' 

* 

Q 

s' 



K 


s* 

R 


K 


X <0. 


which is equivalent to the existence of a matrix K S 
that 

r7'i*rn Qirri 

A 0 


for j = 0,1, Ro e Rj G S™ for j = 

Suppose that there exists a decision function p G C such that 


such 


for every set of Ai > 0, z = 0,..., M. This implies that there 
must exist a matrix iT G K such that 


' I' 

* 

Q 

s' 



K 


s* 

R 


K 



* 

Qj 

Sj 



K 



Rj_ 


K 


^ 0 , 


( 20 ) 


(17) 

Then, there exists a linear decision p{x) = Kx, K G K, such 
that ( [T7| ) is satisfied. 

Proof: Suppose there exists a decision function p G C 
such that is satisfied. Then, for any Gaussian variable 
X ^ A/'(0, X), we have that 


for all j. Finally, (j2^ implies that 



* 

Qj 



' I' 

K 



Rj 


K 


Rj 


X <0 for all X, j = 0,..., M, 

( 21 ) 

■ 

>.X", for i = Let 

G 8™+" for j = 0, ...,M, and Rj G S™ for 


and the proof is complete. 
Theorem 5: Let Cj G 

Qj 


Equivalently, for a given x ^ A/^(0,2f), the optimal value s 
of the optimization problem 


- J "“U 

0=1,..., M. Then, the set of quadratic matrix inequalities 


<0 Vx, j = 0,...,M, 

( 22 ) 


X 

* 

Qj 



X 

KCx 



Rj 


KCx 


(18) 


is equivalent to 

'Qj + SjKC + C*K*S* C*K*R 


subject to E 

j = l,...,M 

must be nonpositive, s < 0. But Theorem gives that the 
decision function p{x) = K{X)x is optimal, with K{X) G K. 
Since Exx* = X, we get the inequalities 


RjKC 


Rj 


^ AO, z = 0,..., M. 

(23) 


X 

* 

Qj 

^Z 


X 

KCx 


[ 5 ; 

Rj 


KCx 


Proof: We have the following chain of inequalities: 

< 0 


^ 0 




' I' 

*■ 

Qj 

Sj' 

' I ' 

KC 



Rj 

KC 


(19) 


Qj + SjKC + C*K*S* + C*K*RjKC A 0 


A = 


Q, + S,KC + C*K*S* C*K*Rj 


RjKC 


-Rj 


AO, 
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2 



4 


Fig. 1. The graph reflects the interconnection structure of the dynamics 
between four systems. The arrow from node 2 to node 1 indicates that system 
1 affects the dynamics of system 2 directly. 


where the last equivalence follows from taking the Schur 
complement of Rj in A (see cni). Hence, our optimization 
problem becomes 


Qj + SjKC + C*K*S* 

RjKC 


C*K*Rj' 

—Rj 


^0, 


for i = 0, M. This completes the proof 


(24) 


VII. Distributed Linear Quadratic Control with 
Quadratic Constraints 


In this section, we will treat the distributed linear quadratic 
7^2 control problem with information constraints, which can 
be seen as a dynamic team decision problem. The idea is 
to transform the dynamic team problem to a static one, and 
then explore information structures for every time step. The 
information structure we will be concerned with is the partially 
nested information structure which was introduced in lO. 

Consider an example of four dynamically coupled systems 
according to the graph in Figure VII The equations for the 
interconnected system are given by 


xi{k + 1) 


Uii 

0 

^13 

0 ■ 


xi{k) 

X2(fc + 1) 


A 21 

A 22 

0 

0 


X2{k) 

xzlk + 1) 


0 

A 32 

^33 

Asi 


X3{k) 

\_X4{k + 1) 


0 

0 

0 

^44 


Xi{k) 


a:(fc+l) A x{k) 


0 

0 

0 

D? 


Ml(fc) 


wi{k) 

0 

0 

(M 

0 


U2{k) 

+ 

W2{k) 

0 0 H3 0 


Usik) 

wsik) 

1- 

0 

0 

0 

ta 

1_ 


Ui{k) 


Wi{k) 




B u{k) w{k) 

(25) 

For instance, the arrow from node 2 to node 1 in the graph 
means that the dynamics of system 2 are directly affected by 
system 1, which is reflected in the system matrix A, where the 
block ^21 7 ^ 0. On the other hand, system 2 does not affect 
system 1 directly, which implies that A 12 = 0. Because of 


the “physical” distance between the subsystems, there will be 
some constraints on the information available to each node. 
The observation of system i at time k is given by 

Vzik) = C,Xi{k), 


where 

'Cii 0 0 o' 

^ _ 0 Q 2 0 0 

0 0 ^3 0 

0 0 0 Ca 


(26) 


Here, Cij = 0 if system i does not have access to yj{k). The 
subsystems could exchange information about their outputs. 
Every subsystem recieves the information with some time 
delay, that is reflected by the interconnection structure. Let 
denote the set of observations yj{n) and control signals 
Uj{n) available to node i up to time k, n < k, j = 

Consider the following (general) dynamic team decision 
problem with additional quadratic constraints; 


inf J(u, w) 


subject to x{k + 1) = Ax{k) + Bu{k) + w{k) 


where 


yi{k) = Cix{k) 
u,{k) = fi, : ^ RP- 

for 7 = 1 ,N 


T-l 

Ee 


x{k) 

ulk) 


Qj 


k=0 

for j = 1, ...,M 


x{k) 

ulk) 


< 1 , 


J{u,w) = Ex*{T)QfX*{T) 


+ Ee 


k=0 


x{k) 

ulk) 


Q 


x{k) 

ulk) 


(27) 


(28) 


Qf,Q,Qj >- 0, x{k) G R", G R™‘, u,{k) G W\ 
Now write x{k) and y{k) as 


t-i 

x{k) = A*x{k — t) + ^ A^Bu(k — n — 1) + 

n—0 
t-l 

+ ^ A^w{k — n — 1), 

n—0 

t-l 

y,{k) = C^A*x{k -t) + Y^ CiA^Bu{k -n-l) + 

n—0 

t-l 

+ ^ CiA^w{k — n — 1). 

n=0 


(29) 


Note that the summation over n is defined to be zero when 

t = 0 . 

The next result is an extension of 11 for the case of 
optimal control with additional quadratic constraints where it 
presents a condition on the information structure for which a 
dynamic problem can be transformed to a static team problem. 
The condition is known as the partially nested information 
structure. 































Theorem 6: Consider the optimization problem given by 
(j27jl with the exogenous input w = (w*(0) w*(l) ...)* such 
that < oo. The problem is equivalent to a static team 

problem in the form ([^ if 


Uj{k — n — 1) S if for [CiA'^B]ij ^ 0 


(30) 


for all n such that 0 < n < f, f = 0,1, 2,.... In particular, the 
optimal solution to the optimization problem given by ( [27| is 
linear in the observations if if condition (301 is satisfied. 
Proof: Introduce 


decision problem: 


inf E 

X 

*■ 

Q 

X 



u 

U 


subject to Uii 

k) 

= Ti(,yi{k)) 


for i = 1,2,... 


X 

*■ 

X 


Qj 


u 


u 


for j = 1,2,...,M 


( 32 ) 


and the optimal solution u is linear according to Theorem 
This completes the proof. ■ 



u>(0) 



X = 

u;(l) 

, u^ = 

Ui{l) 


Then, we can write the cost function J{x,u) as 


X 

* 

X 


Q 


u 

u 


for some symmetric positive dehnite matrix Q. Similarly, the 
quadratic constraints 


Ee 


fc=0 


x{k) 

u{k) 


Qj 


x{k) 

ulk) 


< Ij 


may be written as 


VIII. Conclusions 

We have studied multi-objective linear quadratic optimiza¬ 
tion of team decisions in both stochastic and deterministic 
settings. Constrained decision problems tend to have nonlinear 
optimal solutions. We have shown that for the Gaussian and 
worst case scenario settings, respectively, linear decisions are 
in fact optimal, and we can find the respective linear optimal 
solutions by solving a semidefinite program. We also showed 
that linear decision are optimal when the number of players in 
the time is inhnite. Future work will consider an 5-procedure 
sort of a result, where we want to hnd decision function 
p such that the inequality Jo{fi{x),x) < 0 is satisfied if 
Ji{fj,{x),x) < 0, where Jq, Ji are some quadratic forms in 
p and X. However, this is a much harder problem since the 
search for linear a function fi{x) is not a convex problem, and 
it’s not clear if it can be convexihed. 


E 


X 

* 

X 


Qj 


u 

u 


< 


for some symmetric positive definite 
1,..., M. Consider the expansion given by (|29|). The problem 


matrices Qj, 


J = 


here is that yi{k) depends on previous values of the control 
signals u{n) for n = 0,..., k—1. The components Uj{k—n—l) 
that yi{k) depends on are completely determined by the 
structure of the matrix [CiA^B]ij. 

Now if condition ( |30l l is satished, node i has the information 
of Uj{k—n—l) available at time k if the element [CiA^B]ij 
0. Then, node i can form the new output measurement 


fc-i 


yi{k) = yi{k) - ^ CiA^Buik - n - 1) 

n—0 

k-1 

= -f C^A'^w^k - n - 1). 


(31) 


n=0 


Let 


yi{k) 


'y^{^) 

y*(i) 


With these new variables introduced, the optimization problem 
given by equation (27 1 reduces to the following static team 
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Appendix 

Let J = J{u, w) be a functional defined on a product vector 
space U X W, to be minimized hy u G U C U and maximized 
hy w G W G W, where U and W are the constrained sets. 
This dehnes a zero-sum game, with kernel J, in connection 
with which we can introduce two values, the upper value 

J := inf sup Jiu.w), 

and the lower value 

J := sup inf J(u,w). 

w^W 

Obviously, we have the inequality J > J. If J = J = J,^, then 
J* is called the value of the zero-sum game. Furthermore, if 
there exists a pair (it* £ C/, lu* € VF) such that 

= J*, 

then the pair (it*,i(;*) is called a (pure-strategy) saddle- 
point solution. In this case, we say that the game admits a 
saddle-point (in pure strategies). Such a saddle-point solution 
will equivalently satisfy the so-called pair of saddle-point 
inequalities'. 

J{Ui,,w) < J{Ui,,Wi,) < J{u,Wi,), Vit G U,Vu> £ W. 

Proposition 2: Consider a two-person zero-sum game on 
convex hnite dimensional action sets Ui x U2, dehned by the 
continuous kernel J{ui,U 2 ). Suppose that J{ui,U 2 ) is strictly 
convex in iti and strictly concave in U 2 . Suppose that either 
(i) Ui and U 2 are closed and bounded, or 
(ii) Ui C 1 = 1,2, and J{ui,U 2 ) -G 00 as ||ui|| —>■ 00 , 
and J{ui,U 2 ) -G —00 as |jM 2 || —J' 00 . 

Then, the game admits a unique pure-strategy saddle-point 
equilibrium. 

Proof: See ifTTI . pp. 177. ■ 


